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ABSTRACT 


A  convolution  system  can  have  a  frequency  response  which  is 
small  for  all  frequencies,  yet  still  greatly  amplify  the  peaks  of  signals 
passing  through  it.  For  finite  dimensional  systems,  however,  we  estab¬ 
lish  the  simple  bound  \\h  II  j  <(2n+l)  II /t  II H-,  where  \\h  11}  is  the  peak 
gain  of  the  system,  II  h  II H-  is  the  maximum  frequency  response  of  the 
system,  and  n  its  dimension.  The  same  result  for  continuous  time  sys¬ 
tems  is  due  to  Gohberg  and  Doyle  and  is  mentioned  in  [HWL]. 

The  bound  implies  that  H°°-optimal  controllers,  which  minimize  the 
maximum  of  some  disturbance-to-error  transfer  function,  cannot  have 
very  large  peak  gains  from  the  disturbance  to  error. 
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1.  Introduction 


We  consider  the  discrete-time  convolution  system  y  =h*u  where  u  (the  input), 
y  (the  output )  and  h  (the  impulse  response )  are  real  valued  sequences  on  the  nonne¬ 
gative  integers  Z  +  ^  {0, 1,2...},  and  h*u  is  defined  by 


yt  =  tK-iUi 

«=  o 


(1.0.1) 


We  now  examine  several  different  measures  of  the  ‘size’  of  a  signal  or  the  ‘gain’  of 
the  convolution  system  (1.0.1). 
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1.1.  BIBO  Stability  and  Peak  Gain  i  _ 

The  peak  or  l°°-norm  of  a  signal  u  is  defined  by 

\\u  IL  £  suglw*  * 

The  set  of  bounded  sequences,  that  is,  those  with  finite  peak,  will  be  denoted  1°°, 
as  usual.  The  system  (1.0.1)  will  have  the  property  that  its  output  y  is  bounded  when¬ 
ever  its  input  u  is  bounded  if  and  only  if 

£1*1,1  £  H/HIjCoo  (1.1.1) 

i=0 

in  which  case  we  can  bound  the  peak  of  the  output  by 

Hy  II oo  £  ll/t  N i  II u  llM  (1.1.2) 

This  last  property  (1.1.2)  is  called  bounded  input  bounded  output  (BIBO)  stability;  a 
convolution  system  satisfying  (1.1.1)  is  called  BIBO  stable.  The  bound  (1.1.2)  is  in 
fact  sharp,  since  there  is  a  nonzero  u  e  I°°  with 

II h*u  IL=  II u  IIJIA  II, 

Thus  II  h  II,  is  the  peak  gain  of  the  convolution  operator  (1.0.1);  it  is  the  maximum 
factor  by  which  the  convolution  operator  can  increase  the  peak  of  its  input. 

c 

1.2.  I2  or  RMS  Gain 

i 

Another  useful  norm  on  signals  is  the  l2-norm 

foo  V/2 
llw  H2  =  S>2 

i=0 

which  may  be  interpreted  as  the  squareroot  of  the  total  normalized  energy  in  the  signal 
u .  I2  will  denote  the  set  of  signals  with  finite  l2  norm.  The  convolution  operator 
(1.0.1)  will  map  l2  signals  into  I2  signals  if  and  only  if  the  power  series 

H(X)  £  £ hiV  (1.2.1) 

1=0 

is  analytic  and  bounded  for  (complex)  IAJ  <  1,  that  is, 

II All h-  *  SUp  f^X'Icoo  (1.2.2) 

j= 0  I 

in  which  case  the  following  bound  holds: 

lly  ll2  ^  II h  llH.llu  ll2 


(1.2.3) 


Such  systems  are  called  l2-stable. 

The  bound  (1.2.3)  is  also  sharp;  there  are  u  e  l2  with  lly  W^Wu  M 2  as  c^ose  as  we 
want  to  II  h  II H-,  (but  not  equal,  as  in  peak  case,  unless  H  has  constant  modulus  on  the 
unit  circle).  Hence  II  h  llH-  may  be  interpreted  as  the  l2  gain  of  the  convolution  opera¬ 
tor  (1.0.1). 

We  remark  here  that  the  power  series  (1.2.1)  need  not  converge  for  1X1=1,  and 
that  the  requirement  (1.2.2)  is  strictly  weaker  than  (1),  since  ll/t  llH-<  II  h  II  j.  Thus 
every  BIBO  convolution  operator  is  l2-stable,  but  not  vice  versa.  Examples  of  l2-stable 
but  not  BIBO  stable  convolution  operators  are  quite  contrived;  one  is  given  by 

hk  £  (k ! )~lH (*  >(0),  H(X)  =  e  lKX~l)  (1.2.4) 


When  the  convolution  operator  is  also  BIBO  stable,  the  power  series  (1.2.1)  does 
converge  for  1X1=1  and 

II h  llH-  =  supl//(e'0)l 
0 

Thus  the  l2-gain  II  h  II H-  can  be  interpreted  as  the  maximum  frequency  response  of 
(1.0.1),  that  is,  the  maximum  steady  state  response  to  sinusoidal  inputs  bounded  by 
one.  We  note  for  later  reference  that  the  frequency  response  \H{e^)  I  of  a  BIBO 
stable  convolution  system  is  in  fact  a  continuous  function  of  9. 


Another  interpretation  of  \\h  II H-,  perhaps  more  often  appropriate,  is  as  the  RMS 
gain  of  (1.0.1).  Let  us  define  the  RMS  value  of  a  signal  u  to  be 


II  m  HjM/S  =  lim  sup 
K  — *x> 


1  K~l  „ 
~K  £ 

A  i=0 


1/2 


Then  we  have  lly  1 1 RMS  £  IIA  llH-ll«  II RMS ,  and  this  bound  is  sharp,  indeed  there  is  a 
nonzero  u  with  lly  II RMS  =  11  h  llH-ll«  II RMS. 

Note  that  IMI/m/s  is  not  a  norm,  but  only  a  seminorm,  since  we  can  have 
nonzero  signals  with  zero  RMS  value.  For  example,  any  ‘transient’  or  decaying  u 
(u  (& )  — >  0  as  &  — >  °°)  has  zero  RMS  value. 


1.3.  RMS  Response  to  White  Inputs  , 
We  say  that  a  signal  u  is  white  if 


1  *-i  J  1 

lim  —  =  ‘  0 

K  is: 0 


m= 0 
m>  0 


Thus  white  signals  have  an  RMS  value  of  1. 


While  \\h  II H-  is  the  maximum  RMS  value  of  the  output  of  (1.0.1)  when  the 
input  signal  has  RMS  value  1,  if  we  restrict  our  attention  to  white  input  signals  the 
RMS  value  of  the  output  is  always  II  h  II 2,  that  is, 

II h*u  lljj^s  =  II  h  II 2  for  u  white 

1.4.  Relations  Among  Peak  and  RMS  Gains,  RMS  Response  to  White  Inputs  , 

We  have  seen  three  measures  of  the  ‘size’  of  the  system  (1.0.1):  its  peak  and 
RMS  gains,  and  its  RMS  response  to  white  inputs.  Intuition  suggests  that  these  meas¬ 
ures  are  related.  For  example,  it  is  tempting  to  conclude  that  if  (1.0.1)  has  small  RMS 
gain,  it  should  have  small  peak  gain,  but  this  is  simply  not  true. 

In  general  nothing  can  be  said  other  than 

II h  \\2<  II h  llH-  <  II h  lit 

Convolution  systems  with  small  RMS  gain  can  have  arbitrarily  large  peak  gains, 
indeed  infinite  peak  gain.  The  system  (1.2.4)  described  in  §1.2  has  finite  RMS  gain 

II  h  II H-  =  ^sup^  \e  |  =  e~vl 

but  infinite  peak  gain,  since  as  noted  in  §1.2  BIBO  stable  convolution  systems  have 
continuous  frequency  responses,  yet  for  this  example,  //(ey0)  is  not  continuous  at  0=0. 

Similarly  a  convolution  system  can  have  small  RMS  response  to  white  inputs  but 
infinite  RMS  gain;  an  example  is  given  by  //(X)  =  (l-k)-1/3,  that  is, 

h  £  (k\)-wk\o)  =  v-'7'  '3kJ3k~2) 

This  H  is  unbounded  near  A.=l,  hence  II  h  llH-=«>,  and  so  this  convolution  system  can 
have  infinite  RMS  response  to  an  input  with  RMS  value  finite,  say,  1.  However,  its 
RMS  response  to  white  inputs  is  finite,  since 

2k 

II  h  II 22  =  (27C)-1  J  l//(ey0)l2d0 
o 

7t  1 

=  jr 1 2"1/3 J(  1  -cos0)"1/3d 0  =  7T12-1/3Jm-5/6(2-m)  ~mdu  <  K-l2m-3 
o  o 


2.  Controller  and  Filter  Design  /  t*  >c 

Many  problems  in  controller  and  filter  design  can  be  cast  in  terms  of  making 
some  ‘error’  convolution  operator  ‘small’  (see,  e.g.,  [VID2]).  Usually  the  error  opera¬ 
tor  can  be  interpreted  as  mapping  an  input  or  disturbance  to  an  error  or  output. 
Depending  on  our  notion  of  size  of  a  convolution  operator,  the  goal  of  minimizing  the 
error  operator  yields  different  controller  or  filter  design  schemes. 

The  linear  quadratic  Gaussian  (LQG)  controller  minimizes  the  RMS  response  to 
white  inputs  of  a  certain  (usually  multi-input  multi-output)  error  convolution  operator. 
In  1979,  Zames  [ZAM1]  pointed  out  that  controller  design  schemes  which  minimize  a 
gain  (‘multiplicative  seminorm’)  have  more  desirable  robustness  properties  than  those 
which  minimize  a  measure  of  the  error  operator  which  is  not  a  gain,  e.g.  the  RMS 
response  to  white  inputs.  He  proposed  to  design  controllers  which  minimize  the  RMS 
gain  of  the  error  operator,  that  is,  the  H°°  norm  of  the  error  impulse  response. 

Implicit  in  such  frequency  response  methods  is  the  assumption  that  in  practice,  an 
error  operator  small  in  the  sense  of  maximum  frequency  response  should  be  small  in 
other  senses,  e.g.  peak  gain.  The  examples  given  in  §1.4  show  that  this  assumption 
does  not  hold  generally,  but  we  will  show  that  a  weak  form  of  this  assumption  does 
hold  in  practice. 

Recently  Vidyasagar  [VID1]  proposed  to  design  controllers  which  minimize  the 
peak  gain  of  an  error  operator,  that  is,  the  l1 -norm  of  the  error  impulse  response; 
Dahleh  and  Pearson  [DAH1]  gave  a  solution  to  the  ^-optimal  controller  design  prob¬ 
lem  for  discrete-time  systems  in  1985.  A  question  which  arises  immediately  is,  how 
different  can  systems  designed  with  LQG,  H°°  and  ^-optimal  controllers  be?  The 
examples  of  §1.4  suggest  that  they  can  be  radically  different. 

3. "  Bounds  for  Finite  Dimensional  Systems  , 

In  most  cases  of  practical  interest,  the  impulse  response  h  is  that  of  a  finite¬ 
dimensional  dynamical  system  {A,  b ,  c ,  d): 

xk+ 1  =  Axk  +  buk  yk  =  cxk  +  duk  x0  =  0  (3.1) 

where  A  e  1R"W,  b,  cT  e  1R”,  and  d  e  1R.  Thus  h0=d,  and  for  k  >0,  hk  =cAk~xb. 
For  such  impulse  responses  it  is  possible  to  bound  the  peak  gain  in  terms  of  the  RMS 
gain  and  n ,  the  dimension  of  the  state  space. 

Theorem  1:  If  h  comes  from  the  dynamical  system  (3.1),  then 


llh  llj  £  (2/1+1) HA  !!„■ 


(3.2a) 
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If  in  addition  d= 0,  then 

ll/t  II,  <2n  ll/t  II H-  (3.2b) 

The  continuous-time  version  of  Theorem  1  is  a  recent  (unpublished)  result  of 
Gohberg  and  Doyle  [HWL], 

We  mention  that  these  bounds  are  asymptotically  sharp,  that  is,  there  is  a 
sequence  of  dynamical  systems  with  the  ratios  of  peak  to  (2tt+l)  times  the  RMS  gain 
converging  to  one  as  n  — >  °°. 

Of  course  the  bounds  are  sharpest  when  n  is  as  small  as  possible,  i.e.  the  system 
(3.1)  is  a  minimal  realization  of  h.  We  henceforth  assume  this.  We  will  also  assume 
that  the  system  is  l2-stable,  since  otherwise  the  bounds  above  are  vacuous;  with  the 
minimality  assumption  this  implies  that  the  eigenvalues  of  A  have  magnitudes  less 
than  one. 

In  fact  the  results  (3.2)  are  implied  by  a  sharper  bound  involving  the  Hankel 
singular  values  of  the  impulse  response  h.  Recall  that  the  Hankel  singular  values 
G//1,  .  .  .  ,G//„  of  (3.1)  are  the  squareroots  of  the  eigenvalues  of  W0WC,  where  WQ 
and  Wc  are  the  observability  and  controllability  Grammians  of  (3.1),  i.e. 

Wa  £  ZATkcTcAk  Wc  £  ZAkbbTATk 

k= 0  *= 0 

(these  sums  make  sense  because  the  eigenvalues  of  A  have  magnitude  less  than  one). 
We  order  the  Hankel  singular  values  as  usual: 

<J//i  £  •  • '  ZOHn>  0 

The  OfH  ’s  depend  only  on  the  impulse  response  h  and  not  on  the  particular  realization 
{A ,  b ,  c ,  d}  of  h,  and  so  may  be  unambiguously  called  the  Hankel  singular  values  of 
h. 

Theorem  2: 

ll/t  II  j  ^  Id  I  +  2(a//1+...+o//„)  (3.3) 

We  postpone  the  proof  of  Theorem  2. 

Lemma  1: 

II  h  II H-  >  0//J 


Lemma  1  is  well  known;  it  follows  immediately  from  the  characterizations 


ll/t  II h-  =  sup-( 


£y,2 1  2>,2  =  i.  y=h*u 

1=0  i=0 


(see  e.g.  [DES]  for  the  first  and  [GLO]  for  the  second).  Thus  II  h 
Theorem  1  follows  immediately  from  Theorem  2  and  lemma  1: 

II h  II j  <  \d\+T£pm  <  \d\+lnaHl  <  \d\+2n  II h  l^- 

Setting  d=  0  yields  (3.2b).  Noting  that  \\h  llH->  I// (0)1  =  \d  I  yields 
II /i  II !  <(2n+l)  ||/j  II  H_,  which  is  (3.2a). 

We  mention  here  that  the  sharper  bound  (3.3)  shows  that  the  order  n  appearing  in 
the  bounds  (3.2)  can  really  be  taken  to  be  the  effective  order  of  the  system,  meaning 
the  number  of  significant  Hankel  singular  values,  as  opposed  to  the  number  of 
nonzero  Hankel  singular  values. 

Proof  of  Theorem  2: 

II h  II  j  =  \d  I  +  £l cAkb  I  = 

k=0 

=  Id  I  +  X\cA2kb\  +  Z\cA2k+lb\  (3.4) 

k=0  fc=Q 

Let  us  first  consider  the  second  term  in  (3.4).  By  the  Cauchy-Schwarz  inequality  in 
IR",  \cA2kb  I  <  \\ATkcT  \\2\\Akb  ll2,  so 


X  I cAub  I  <  £  I IATkcT  \\2\\Akb  ll2  <; 

k=0  k=0 


oo 

1/2 

OO 

< 

X  \\ATkcT  ll2 

ZUAkb\\$ 

k= 0 

J 

k= 0 

1/2 


1/2 


=  ( TrW0TrWc ) 


using  the  Cauchy-Schwarz  inequality  in  I2.  Similarly  the  third  term  in  (3.4)  can  be 
bounded  above  as 


£ \cA2k+1b  I  <  £  II ATkcT  ll2ll Ak+lb  ll2  < 

k= 0  k= 0 


* 

OO 

1/2 

'  .  \ 

OO 

< 

£  II ATkcT  ll22 
k=  0 

V  i 

£  II Ak+lb  ll22 

k=  0 

1/2  \rr^AkbbTATk  ]  =  (TrW0)m(TrWc  -  II b  ll22)1/2 


=  (TrW0) 


Thus  from  (3.4), 


ll/>  II  j  <  Id  I  +  2(TrWaTrWc)m  (3.5) 

Now  (3.5)  is  true  for  any  realization  { A,b,c,d }  of  h;  in  particular  for  a  balanced 
realization  [Ab , bb , cb , d }  of  h,  we  have  Wa  =WC  =diag[aHl,...,aIln]  Thus  we 

have 


Wh  II  j  ^  Id  I  +  2(ow j+...+a//„ ) 
which  establishes  Theorem  2. 

It  is  interesting  to  note  that  expressions  similar  to  TrW0TrWc  have  appeared  in 
recent  work  on  sensitivity  and  overflow  analysis  of  realizations  of  h  [MUL.THI]. 

It  is  worth  mentioning  that  the  balanced  realization  used  above  yields  the  best 
bound  for  II  h  II  j  based  on  the  inequality  (3.5).  We  will  now  show  among  all  realiza¬ 
tions  of  h,  TrW0TrWc  has  minimum  value  which  is  achieved  by  and  only  by 

any  realization  with  Wa  a  multiple  of  Wc,  the  balanced  realization  a  special  case  of 
this. 


For  any  matrices  F  and  G  we  have  the  inequality 

,2  -i“ 


Tr(FTG)  =  lfijG,I  £ 
ij 


IF  ij  TP  id 

i,j  kj 


=  ^Tr(FTF)Tr(GrG )] 


1/2 


with  equality  if  and  only  if  F  and  G  are  multiples  of  each  other.  Now  if  W0  and  \VC 
are  the  Grammians  of  any  (order  n )  realization  of  h ,  then  they  can  be  expressed  as 


W„  =  TtZhT 


Wc  =  T-'ZhT~t 


where  T  is  some  nonsingular  matrix  (in  fact,  the  coordinate  transformation  taking  the 
balanced  realization  into  the  given  realization).  Applying  the  inequality  above  with 
F  =Z/1/2r  and  G  ='L?i,2T-t  yields 

C TrW0TrWc)m  >  Tr{TTZl{T~r)  =  TrZH  =  JpUi  (3.6) 

Moreover  equality  obtains  only  when  E//2  T  is  a  multiple  of  'L}(2  T~t  ,  which  is 
equivalent  to  TTt  =  a I  for  some  constant  a.  This  implies  that  a 2W0  =  Wc ;  conversely 
if  WQ  is  a  multiple  of  Wc ,  then  TTt  =  aJ  for  some  constant  a,  and  equality  obtains  in 
(3.6).  Thus  the  claim  above  is  established. 

Finally,  we  note  that  it  is  not  possible  to  bound  the  RMS  gain  of  a  finite  dimen¬ 
sional  system  in  terms  of  its  RMS  response  to  white  inputs  and  its  order.  Let  0<r  <  1, 
and  consider  the  first  order  system  =rxk+uk,  yk  =xk.  Thus  hQ  =  0  and  for  k  >0, 

hk=rk~l ,  so  ll/i  II H-  =  (1— r )— !,  and  ll/i  II 2  =  (1— /"2)-1/2.  For  r  near  one,  the  ratio 
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II  h  lllr/ll/z  II 2  is  unbounded,  establishing  the  impossibility  of  bounding  this  ratio  in 
terms  of  the  system  order  (here,  one). 
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